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1  Executive  Summary 

In  this  project,  to  continue  our  development  of  a  system  that  can  dynamically  collect  and 
warehouse  unfiltered  textual  communication  data  and  make  this  data  available  to  support 
HSCB  modeling,  decision  making,  and  course  of  action  development,  we  have 
accomplished  the  following. 

First,  we  have  developed  algorithms  and  an  end-to-end  computational  framework  to 
ingest  Twitter  data,  convert  it  into  Twitter  interaction  and/or  friendship  graphs,  and  store 
in  a  graph  database,  namely  OrientDB.  We  have  also  enhanced  Scraawl’s  current  graph 
visualization  for  scalability  and  usability. 

Second,  we  have  developed  graph  querying  capabilities  and  implemented  various  UIs  to 
visualize  the  outputs  of  these  queries.  In  particular,  we  have  developed  top  K  user  and/or 
hashtag  query,  and  n-hop  neighborhood  queries.  Various  attributes  of  the  nodes  and 
edges  can  also  be  interactively  visualized. 

Third,  we  have  developed  automated  YouTube  video  metadata  collection  capabilities.  In 
particular,  we  have  developed  two  APIs  for  continuous  (Streaming)  and  recent  YouTube 
data  searches,  and  designed  a  user-friendly  UI  for  these  searches  using  YouTube  Data 
API  v3.  Algorithms  to  perform  basic  statistics  computation,  NER,  and  map  visualization 
have  also  been  designed  and  implemented. 

Fourth,  we  have  developed  automated  VK  data  collection  capabilities.  Algorithms  to 
perform  basic  statistics  computation,  NER,  and  map  visualization  have  also  been 
designed  and  implemented. 

Finally,  we  released  Scraawl  2.0,  which  incorporates  these  features. 
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2  Technical  Work 


2.1  Store  Twitter  Interaction  Graphs  in  OrientDB 

The  first  step  in  developing  the  querying  capability  is  to  store  a  graph  efficiently.  A  graph 
database,  for  all  practical  purposes,  can  be  represented  as  the  graph  itself.  In  its  simplest 
form,  we  consider  the  Twitter  interaction  graph  modeled  as  an  undirected  graph  G  = 
( V ,  E),  where  V  is  the  set  of  nodes  (vertices)  and  E  is  the  set  of  edges.  For  a  collection  of 
tweets  {t(0)|  9  £  Z+],  where  each  tweet  r(. )  can  be  uniquely  identified  by  its  unique 
tweet  ID  6  6  7L+ ,  let  t(9)  be  tweeted  by  user  uT^  and  let  uT^  have  retweeted, 

mentioned,  or  replied  to  Kg  users  j(r(0))  =  {v^gy  vt(G)>  ■■■  -  ut"(6»)}-  Of  course,  if  no 
retweets,  mentions,  or  replies  are  present,  then  j(r(0))  =  0.  We  can  then  unambiguously 
specify  the  Twitter  Interaction  Graph  G  with  V  =  [ur^  U  j(r(0))|  9  E  TL+)  and  E  = 
[ur (e)  xl(m)\9  El+}=  {(uT(e),  v^(0)),  (uT(0),  v?(d)), ,  (uT(e),  v?(e)) 1 9  El+}. 

One  can  enhance  G  by  adding  other  types  of  interactions,  e.g.,  by  adding  an  edge  if  a  user 
uses  a  hashtag  in  his/her  tweet.  In  this  particular  case,  the  vertex  set  will  have  hashtags  as 
well.  Note  that  this  definition  can  trivially  be  extended  for  friendship  graphs ,  where  the 
interactions  between  users/nodes  are  whether  they  are  friends  and/or  followers. 

To  implement  the  graph  modeling  capabilities  above,  we  used  an  open  source  graph 
database,  namely  OrientDB  (http://www.orientdb.com),  and  an  SQL-like  graph  querying 
language.  OrientDB  provides  an  NoSQL  engine  that  stores  and  queries  graphs  via  both  (i) 
a  graph  database  API  and  document  API,  and  (ii)  supports  schema-less,  schema-full,  and 
schema-mixed  modes.  Our  initial  experimentation  with  OrientDB,  an  open  source  graph 
database,  and  its  SQL-like  graph  querying  language  yielded  promising  results.  In 
particular,  we  inserted  a  Twitter  Interaction  Graph  with  \V\  >  34 k  and  |£"|  >  421  k  in 
less  than  6  minutes.  In  addition,  we  ordered  nodes  of  this  graph  by  degree  in  less  than  2 
seconds.  A  basic  graph  service  that  performs  basic  graph  database  management 
operations,  e.g.,  insert,  delete,  update,  is  also  implemented. 

We  have  also  designed  and  implemented  the  &-hop  neighbor  queries.  In  brief  and 
informally,  starting  from  a  node  v,  /c-hop  queries  finds  the  neighbors  of  v,  neighbors  of 
neighbors  of  v  (a.k.a.  second  degree  neighbors),  and  so  on  until  &-hop  neighbors.  In 
particular,  for  a  querying  function  Q(.),  a  “2 -hop”  neighbors  query  is  implemented  as 
follows. 

Q(v )  =  {(v, v')  U  (v' ,v'')\(v,v')  6  E  and  6  E  for  V  v' ,v"  6  k). 

This  can  be  generalized  to  &-hop  by  including  neighbors  of  neighbors  of  neighbors  up  k- 
hop. 

This  querying  service  has  also  been  implemented  using  a  Groovy/Grails  framework  with 
functions  written  in  Java. 
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2.2  Design  and  Implement  Visualization  and  UI 

To  visualize  the  graph  returned  by  the  queries,  we  have  further  developed  IAI’s  graph 
visualization  capabilities.  We  have  also  incorporated  a  UI  to  call  the  Uhop  query  service. 
These  capabilities  are  all  incorporated  to  Scraawl. 

Figure  1  is  a  visualization  for  4-hop  neighborhood  query  starting  from  #EasterEggRoll. 
The  Twitter  interaction  graph  has  been  created  from  a  collection  of  tweets  that  have  been 
collected  between  28  Mar,  2016  03:00  AM  and  29  Mar,  2016  02:59  using  the  keyword 
#EasterEggRoll.  Overall,  25063  tweets  were  collected.  The  graph  has  16171  nodes 
(vertices)  and  48594  edges. 

The  “Neighbors”  button  to  the  upper  left  corner  call  the  k-hop  querying  service  with  (i) 
starting  node  (in  this  case  #EasterEggRoll),  and  (ii)  the  ^-parameter  (in  this  case  k  =  4). 


Figure  1:  4-hop  neighborhood  query  starting  from  “#eastereggroll”. 
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2.3  Top  K  User  and  Hashtag  Subgraph  Querying  and  Visualization 
2.3.1  Top  K  Query  Implementation 

As  reported  in  Progress  Report  No.  1,  we  consider  the  Twitter  interaction  graph  modeled 
as  an  undirected  graph  G  =  ( V ,  E),  where  V  is  the  set  of  nodes  (vertices)  and  E  is  the  set 
of  edges.  For  a  collection  of  tweets  (r(0)|  9  G  Z+],  where  each  tweet  r(. )  can  be 
uniquely  identified  by  its  unique  tweet  ID  6  G  TL+ ,  let  t(9)  be  tweeted  by  user  uT^  and 
let  uT(0)  have  retweeted,  mentioned,  or  replied  to  Kg  users  j(r(0))  = 
iVT(0)’  vt(6)>  —•  Of  course,  if  no  retweets,  mentions,  or  replies  are  present,  then 

j(r(0))  =  0.  We  can  then  unambiguously  specify  the  Twitter  Interaction  Graph  G  with 
V  =  {uT(e)  U  J(t(0))|  9  G  TL+)  and  E  =  {uT(e)  x  J(t(0))|  9  El+}  =  {(urie), 

(uT(e),  v|(0)), ... ,  (uT(e),  V?w)  1 9  G  T+). 

Our  interest  lies  in  the  querying  of  this  graph.  We  first  define  a  generic  query  operator 
over  the  graph  that  will  return  a  subset  of  the  graph,  i.e.,  Q(. ):  G  ■-»  G.  In  this  reporting 
period,  we  have  designed  and  implemented  top1  K  neighborhood  queries.  Formally,  we 
define  the  top  K  neighborhood  query  as 

Q  v^j  =  G(V',E')  where  V'  =  vt  U  N(Vi)^jand  s.t.  E'  =  ^J(v£,  v_/(0)» 
where  Vj(i)  G  N(vi) 

for  a  set  of  “top”  U iVt  vertices  and  N(vi)  denotes  the  immediate  neighborhood  of  vt. 
Recall  from  Report  1  that  we  have  designed  and  implemented  a  graph  querying  system 
using  the  graph  database  OrientDB.  We  have  added  the  above  querying  capability 
implemented  using  OrientDB  and  made  it  available  through  Scraawl. 

In  particular,  we  have  implemented  top  K  neighborhood  queries  for  the  following  top  K. 

1.  Top  K  Users:  The  top  tweeting  users. 

2.  Top  K  Hashtags:  The  top  tweeted  hashtags. 

3.  Top  Connected  Users:  Top  users  ranked  by  degree  in  the  Social  Graph. 

4.  Top  Connected  Hashtags:  Top  hashtags  ranked  by  degree  in  the  Social  Graph. 

We  have  also  enhanced  the  visualization  for  top  K  queries.  We  have  improved  the 
visualization  by  (i)  automatically  adjusting  zooming  and  translating  so  that  the  graph  fits 
into  the  visible  screen,  (ii)  incorporating  web  workers,  i.e.,  background  computation 
threads,  so  that  graph  layout  is  computed  without  interfering  with  user’s  interaction  with 
the  page,  and  (iii)  adjusted  the  parameters  of  the  graph  layout  so  that  there  is  less 


1  As  defined  according  to  context  as  shown  in  Section  1.1.2. 
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cluttering.  Figure  2  is  a  representative  visualization  for  a  top  10  query  as  integrated  into 
Scraawl. 


Figure  2:  Representative  visualization  of  Top  10  users. 


2.3.2  Graph  Visualization  for  Friendship  Graph 

We  have  also  designed  and  implemented  a  service  that  retrieves  the  friends  and  followers 
of  a  given  user  and  visualizes  it  in  Scraawl.  Figure  3  is  a  representative  graph 
visualization  of  the  friendship  graph  of  two  users.  The  “queried  users”  are  depicted  as 
orange,  the  common  friends/followers  are  shown  as  green,  and  the  rest  of  the  users  are 
drawn  in  gray.  Unlike  the  Social  graph,  the  friendship  graph  is  directed  hence  the 
direction  of  links  are  represented  in  the  visualization.  The  relationship  “being  a  friend” 
and  “being  a  follower”  are  distinguished  by  using  orange  and  gray  colors. 
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2.4  YouTube  Data  Collection  and  Analytics 
2.4.1  YouTube  Data  Collection 

The  first  API  allows  for  streaming  searches,  i.e.,  adds  a  query  for  continuous  YouTube 
post  collection.  The  second  API  allows  searching  on  recent  YouTube  videos,  and  the 
resulting  data  will  be  saved  in  the  configured  database.  Both  APIs  make  use  of  the  (i) 
Search:  list  Data  API  functionality,  which  returns  a  collection  of  search  results  that 
match  the  query  parameters  specified  in  the  API  request,  and  (ii)  Videos:  list  Data 
API  functionality,  which  returns  a  list  of  videos  that  match  the  API  request  parameters. 
Some  of  the  major  parameters  used  in  the  Scraawl  streaming  and  recent  API  searches  is 
shown  in  Table  1. 


Table  1:  Scraawl  API  Major  YouTube  Data  Collection  Parameters. 


Parameter 

Explanation 

query  .q 

The  'q'  parameter  specifies  the  query  term  to  search  for.  Two 
words  separated  by  spaces  can  be  treated  as  AND.  Your 
request  can  also  use  the  Boolean  NOT  (-)  and  OR  (1)  operators 
to  exclude  videos  or  to  find  videos  that  are  associated  with  one 

of  several  search  terms. 

query.channelld 

The  channelld'  parameter  indicates  that  the  API  response 
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should  only  contain  resources  created  by  the  channel. 

query  .location  & 
query  .locationRadius 

The  'location'  parameter,  in  conjunction  with  the 
'locationRadius'  parameter,  defines  a  circular  geographic  area 
and  also  restricts  a  search  to  videos  that  specify,  in  their 
metadata,  a  geographic  location  that  falls  within  that  area. 

query  .publishedBefore 

The  'publishedBefore'  parameter  indicates  that  the  API 
response  should  only  contain  resources  created  before  the 
specified  time. 

query.publishedAfter 

The  'publishedBefore'  parameter  indicates  that  the  API 
response  should  only  contain  resources  created  before  the 
specified  time. 

We  have  also  developed  a  UI  to  use  the  above  APIs  seamlessly.  A  representative  UI  is 
shown  in  Figure  4.  The  UI  has  the  same  look  and  feel  with  other  social  media  searches, 
and  can  be  accessed  from  “Create  New  Report”  view  under  Scraawl.  The  UI  allows  to 
specify  keywords  with  each  box  “AND”ed,  and  the  translation  capability  using  Google 
translate  is  integrated.  The  user  can  also  choose  between  “Streaming”  and  “Recent” 
searches,  which  in  turn  calls  one  of  the  above  APIs  explained  in  Section  1.1.1.  When 
“Recent”  search  is  selected,  the  user  has  the  option  to  select  a  time  range.  When 
“Streaming”  search  is  selected,  data  collection  will  continue  until  a  pre-specified  time-out 
or  the  data  collection  limit  is  reached.  Similar  to  other  data  feeds,  we  also  allow  the  user 
to  draw  circular  bubbles  on  the  world  map  to  restrict  their  searches  to  certain  region(s) 
under  “Additional  Search  Options.” 


Create  New  Report 

Premium  Search  •  Premium  Advanced  Search  •  Basic  Search  •  User  Search 


Data  sources  . _ . 

•  *  Twitter  O  Blnstagram  C  t  Tumblr  |  •  fcYouTubej  O  M<VK  (Coming  soon:  Sv  News  Feeds) 

Search  keywords 

Keyword:  Olympics  Translate  from:  English  »  Translate  to:  Spanish 


*  Juegos  Oh'mpicos 


^  Hide  translator 


J  Olympics  x 


Juegos  Olimpicos  j 


Separate  keywords  with  commas  to  match  multiple  keywords  (e  g.  youtube,  socialmedia).  Separate  with  spaces  to  include  both  keywords  (e  g.  youtube  socialmedia).  Uses  managed 
YouTube  API,  quota  limits  apply. 

Report  name 

report 


Search  timeline 

Streaming  Recent  I 

Report  limit 


2016-06-1610:03  -  2016-06-2310:03  Time  range  for  recent  search 


Current  limit:  C2>  -  Total  quota  left  in  June,  2016:  gTTfr 
Sets  the  limit  for  the  number  of  posts  in  the  report 

, - > 

|  ►  Additional  Search  Options  • 


Start  Scraawling 


Figure  4:  UI  for  YouTube  Searches. 
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2.4.2  YouTube  Analytics 

We  have  developed  a  fast  and  reliable  computation  of  Top  K  statistics  for  YouTube 
videos.  In  particular,  we  compute  Top  Videos,  Top  Users,  Top  Words,  and  Top 
Languages.  In  all  cases,  “Top”  refers  to  higher  count.  Similar  to  other  data  sources,  we 
have  also  implemented  a  UI  to  show  and  interact  with  these  statistics.  Figure  5  shows  a 
representative  view  of  the  UI.  Top  Videos,  Top  Users,  and  Top  Words  are  shown  as  lists 
while  Top  Languages  are  shown  as  a  pie  chart.  Every  Top  K  Statistics  also  include  a 
drill-down  menu,  where  users  can  access  using  the  “Details”  button.  In  the  drill-down 
menu,  users  can  see  Top  50  statistics  and  other  relevant  metrics.  Also,  users  can  filter  to 
include  or  exclude  the  relevant  posts. 


Basic  Statistics 


SouneM:  &  ■  Folder:  Search  Reports  ■  Report  name:  Pokemor  GO  ■  Search  terms:  Pokemon  GO 

liM  Basic  Statistics 


Status:  Completed  ■  Posts:  100  ■  Updated:  20Juif  2016  10:20  Time-line:  14  Jut,  2016  19:46  -  19Juf,  2016  18:00  4  Actions  - 


FASTEST  WAV  IDO  CATCH  PQ..  5M 

POKEMON  GO  IIS  IlANGERQUi..  4M 

Pokemon  GO  -  HOW  TO  CATC...  3M 

HOW  TO  CATCH  MEWTWO!? ..  .  3M 

I  HATE  POKEMON  00!!!  3M 


100  total  videos 


Details  * 


Top  Users 

■H 

Lachlan 

4 

MareAliA 

4 

PewDiePie 

2 

Presto  nPlayz  -  Mines  raft 

2 

VeHiaify 

2 

90  total  users 

Figure  5:  Representative  Top  K  Statistics  for  YouTube  Videos. 


Similar  to  the  other  data  feeds,  we  have  developed  a  timeline  view  that  shows  the  number 
of  posts.  The  timeline  view  is  interactive  and  the  selected  portion  can  be  filtered  using 
“Filter  By  Range”  as  shown  in  Figure  6. 


Timeline 


We  show  the  snapshots  of  the  Top  50  videos  in  a  grid  under  “Media  Gallery”  view.  The 
video  snapshots  are  clickable  and  each  click  directs  the  user  to  a  page  that  has  statistics 
about  video.  A  representative  media  gallery  view  is  shown  in  Figure  7. 
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Media 


Total  media:  50 


Page:  1/2  Next> 


Figure  7:  Representative  Media  Gallery  View. 


We  perform  Scraawl’s  NER  algorithm  to  the  text  associated  with  YouTube  post,  which 
classifies  the  named  entities  into  organizations,  locations,  and  persons.  Scraawl’s  NER 
also  performs  abbreviation  extensions,  e.g.,  UN  is  mapped  to  “United  Nations.”  A 
representative  NER  view  along  with  other  statistics  is  shown  in  Figure  8. 


Status:  Completed  •  Posts:  100  •  Updated:  20  Jut,  2016  10:20  Timeline:  14Jul,2016  19:46-  19  Jut,  2016  18:00  O Actions ▼ 


Top  Named  Entities 


Next> 

Last» 

Show 

All  ▼ 

[Search  entity 

□ 

[T^l  □ 


Entity 

*  Type 

i  Entity  count 

▼  %  of  entities 

i  Post  count  t 

%  of  posts 

i  User  count 

t  %  of  users 

United  Nations 

fit  Organization 

20 

50.0% 

10 

10.0% 

13 

14.4% 

Society  Of  Indexers 

fit  Organization 

6 

15.0% 

5 

5.0% 

5 

5.6% 

Massachusetts  Institute  Of  Technology 

]R  Organization 

4 

10.0% 

3 

3.0% 

3 

3.3% 

United  States 

9  Location 

4 

17.4% 

4 

4.0% 

4 

4.4% 

Le  Jeu 

A  Person 

4 

4.2% 

3 

3.0% 

3 

3.3% 

Figure  8:  Representative  NER  View. 


We  use  Scraawl’s  Location  Map  and  Heat  Map  view  to  display  geolocation  information 
about  YouTube  videos.  In  particular,  we  show  geo-coded  and  geo-referenced  YouTube 
posts.  Geo-coded  posts  are  those  which  have  GPS  information  on  them  while  geo- 
referenced  posts  are  those  which  mention  location  information.  A  representative  Map 
view  is  shown  in  Figure  9. 
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Figure  9:  Representative  Map  View. 


2.5  VK  Data  Collection  and  Analytics 
2.5.1  VK  Data  Collection 

VK  is  the  largest  European  online  social  networking  service.  It  is  available  in  several 
languages,  but  is  especially  popular  among  Russian-speaking  users.  Similar  to  other 
social  networks,  VK  allows  users  to  message  each  other  publicly  or  privately,  to  create 
groups,  public  pages  and  events,  share  and  tag  images,  audio  and  video,  and  to  play 
browser-based  games. 

In  this  reporting  period,  we  have  matured  VK  crawling  capabilities.  In  particular,  we 
have  developed  a  capability  to  retrieve  VK  posts  based  on  keywords.  Current  search 
grammar  includes  combining  a  set  of  keywords  by  AND’ing  or  OR’ing  them.  The  search 
can  be  performed  as  streaming  or  a  1-week  historical,  and  can  be  combined  with  a  geo¬ 
location  search.  The  search  is  integrated  as  part  of  Scraawl,  and  the  UI  is  shown  in  Figure 
10.  Similar  to  other  social  network  searches,  the  keywords  or  phrases  can  be  entered 
separately,  a  report  name  can  be  given  to  the  search,  and  either  a  streaming  or  a  historical 
search  can  be  chosen.  In  addition,  a  map  is  interactively  used  (not  shown)  to  restrict  the 
search  to  a  geospatial  region. 
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Data  sources 


*  Twitter  0  Instagram  t  Tumblr  ®  YouTube  News  Feeds  ( Disabled)  O  'K  VK 

Search  keywords 
rio201 6  x  Olympics  x  rio  x 

Separate  keywords  with  commas  to  match  multiple  keywords  (e.g.  vk,  socialmedia).  Uses  managed  VK  API,  quota  limits  apply. 

Report  name 


Search  timeline 

Streaming  p  Recent  2016-08-19  15:49  -  2016-08-2615:49  Time  range  for  recent  search 

Report  limit 

Current  limit:  Cfffr  -  Total  quota  left  in  August,  201 6:  mw.ym 
Sets  the  limit  for  the  number  of  posts  in  the  report 

►  Additional  Search  Options 


Start  Scraawling 


Figure  10:  Representative  VK  Search  Screen. 


2.5.2  VK  Analytics 

We  have  also  developed  capabilities  to  compute  basic  statistics  of  the  VK  posts  that  were 
collected  using  the  interface  of  Figure  10.  In  particular,  top  users,  top  words,  top  URLs, 
and  top  attachments  along  with  top  popular  media  is  computed  and  presented  to  the  user 
in  one  screen  as  shown  in  Figure  11.  The  timeline  of  the  posts  (not  shown)  is  also 
presented  in  the  same  screen.  Each  top  statistics  (e.g.,  top  words)  can  be  further  drilled 
down  to  show  additional  information. 
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Basic  Statistics 

Sources:  mc  ■  Folder:  Search  Reports  •  Search  terms:  rio201  ^Olympics, rio 


bill  Basic  Statistics 

Status:  Completed  •  Posts:  429  •  Updated:  26  Aug,  2016  15:50 


Timeline:  25  Aug,  2016  15:54  -  26  Aug,  2016  15:48 


O  Actions  - 


Top  Users 

Top  Words  j 

Cyber  Games  Sport 

10 

YBe/lMMUTb 

544 

CnopT-OKcnpecc 

9 

MneH 

527 

ra3eia.Ru  |  CnopT-... 

6 

OHJiaMH 

221 

E4)HMHR  MflCHMKOBa 

5 

CMOTpeTb 

207 

Marina  Marikova 

4 

Becn/iaTHO 

167 

347  total  users 

7 1,085  total  wo... 

Details  >  | 

Top  URLs 


https://elitsy.ru/rio2... 
http://ask.fm/Ousa... 
https://olymptrade.c.. 
http://howafrica.co... 
http://spb.olympclu... 
76  total  URLs 


Top  Attachments 


5  total  types 


D  Photo 
Link 
P  Video 
[D  Audio 
Album 


View  media  > 


Map  visualization  and  NER  have  also  been  tailored  for  YK. 


3  Documentation  of  Features 

Please  see  the  Scraawl  help  page:  https://blog.scraawl.com/faq/ 
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4  Conclusion 

The  proposed  work  is  expected  to  support  a  variety  of  Navy  Operational  needs  in  the 
areas  of  Disaster  Relief  Operations  (DRO)  and  assisting  decision  makers  and  field 
personnel  to  better  understand  and  address  unexpected  crises.  By  using  graph  analytics  at 
large-scales,  users  will  be  able  to  find  key  actors,  extract  relationships  between  these  key 
actors,  find  pathways  between  leaders  and  followers,  and  interactively  visualize  social 
graphs  and  friendship  graphs.  In  addition,  with  the  added  YouTube  and  VK  capabilities, 
user  will  be  able  to  get  a  broader  range  of  textual  and  relationship  data,  and  will  be  able 
to  support  HSCB  modeling,  decision  making,  and  COA  development. 
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